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Abstract 

This paper describes a CLIPS-based fuzzy expert system development 
calIed FCLIPS and illustrates fts application to the siEed 

CT tp<; withp a r Cing P rob em - FCLIPS is a straightforward extension of 
f L F S without any alteration to the CLIPS internal structures. It makes use 
of the object-oriented and module features in CLIPS version 6 0 for the 
implementation of fuzzy logic concepts. Systems of varying degrees of 
mixed Boolean and fuzzy rules can be implemented in FCLIPS Design and 
implementation issues of FCLIPS will also be discussed. g 

I. Introduction 

Production systems better known as data-driven rule-based expert systems attempt to 

oe encoaea in the form of if-then rules or production rules One of the firct 

System) in C^alnly^o'increase^eed 6 and portabiH^^Becai^of CLIPS^ flejdhtn Ct *°d 
advance!! SSSSS? freq “ en,,y enl,an “ d to embra “ the lat “‘ 

^kte e o S ne b S e ,L°" f “f 2y *' lhe0ry ' also seek to enco<le human problem-solving 

, cont °l [5]. Several commercial hardware and software tools have heen 
introduced recently to build fuzzy systems. are I001s nave been 
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The similar and complementary nature of fuzzy systems and expert systems have naturally 
Rested the Idea of fuzzy expert systems in' which the traditional Boolean production- 
s?ft!m architecture is extended to include the concepts of fuzzy systems. By combining 
the proven techniques of production systems with the fuzzy systems' representation and 
mSaSon , power, we believe the resulting system can effectively address even more 
challenging AT problems. Since the CLIPS source code is available at almost no cost, there 
have be S en 8 attempts to extend CLIPS to a fuzzy expert system development environment. 

most no3 examples are the FuzzyCLIPS from the Knowledge Systems Laboratory 
of the National Research Council of Canada [6], and, also using the same name .the 
FuzzyCLIPS by Togai Infralogics Inc. [7], In this paper we will focus on our own 
implementation. The similarities and differences of these CLIPS-based systems will be 
discu^ed at a later time. An important quality of FCLIPS is the simplicity of tts design, 
while still maintaining the ability to support a wide range of fuzzy expert systems. 

In the following sections, we will describe the architecture of a typical Boolean production 
svstem exemplified by CLIPS, the architecture of a fuzzy system, the design and 
implementation issuesof FCLIPS, the FCLIPS application to the cart-pole balancing 
problem, and future FCLIPS extensions. 


II. Production Systems 

Production systems are based on the principles of modularity and contextual dependent 
reaction in Imman behavior. A typical production system has three distinct modules a 
product memory for conlaininfprodwtion rules, a working memory for facts and an 
inference engine for execution [1]. The production memory contains rules which have the 

form of: 


if <antecedent> then <consequent> 

An example of a CLIPS rule is as follows: 

(defrule My_House 

(the house number is 123) 

(the street name is Pennsylvania) 

=> 

(printout t "It is my house")) 


Antecedent, also called the rule's left hand side (LHS) contains Boolean predicates that 
state the conditions for the actions to take place as specified in the consequent, or the right 
hand side (RHS). A rule becomes a candidate for execution if its antecedent is satisfied by 

facts in the working memory. 

The working memory contains facts which describe the current state of a situation or a 
problem. The set of facts in the working memory is often changed as new data arrives o 
as the result of a rule being executed at each inference cycle. 

The inference engine decides which rule is to be executed given the current set of facts in 
the working memory. It first performs matching between rules and existing facts In 
CLIPS this § matching is implemented using Rete net [2], known as the best pattern 
matching algorithm. After matching, there may be more than one matched rule. The set of 
matched 8 rules is called the conflict set. Only one rule from the conflict set will ^ selected 
to be executed via the process called conflict resolution. Once a rule is selected, its RHS 


frnm U jhP ° ft6n affects the workin § memory by adding, modifying or deleting facts 

from the working memory. As the result of the working memory being changed a new 

SM,“J£SS3L Th ' CyC ' e 8065 « is g emp^ or’a haU 

JprodSSoi - S S K Veral power ^ ul features to the basic architecture 

p oaucuon systems. It has a built-m object-oriented system which ereatlv enhances its 

nrnwf nai0n ca P ablbt y- Instead of using attribute-value predicates as in OPS5 to model 
problems, one can now use classes and objects, which are more natural aid express* ™ 

featur ® of CLIPS is modularity [8], Rules that share some commonality 

S? tfm? offv oSfmoTf 11 C ' ^° dUlCS alIC T th f irn P lernentat ion of context-switching. At 

selection process The rnn?," !* f ! f d 0nIy lts rales Pupate in the matching and 
selection process. The concept of modularity allows more efficient organization of the 

scope and^peed 1 [ 3 J 30 improves the scaIabillt y of a production system in terms of its 

problem 31 ' ^ qUitC effe 1 ctive in P rovidin g heuristic solutions to 
proDiems. they have been used m many real-world problems [51. But while obiect 

S5SZ2 1 ,' representation capabi% of prediction systems, the rule 
St }5 u, l d t0 only Boolean statements which are not always natural to 
£.emat£e pr ° blemS ' ™ S iS “ area where ^ ^ an aTa C ,!ve 


III. Fuzzy Systems 

Fuzzy systems are based on fuzzy set theory [4], 
systems in their use of if-then rules. However, 
First, the LHS and RHS predicates of a fuzzy 
statements. Secondly, fuzzy rules whose RHS 
same subject, are all executed and collectively 
Boolean production system, rules compete to be 
expert system rules: 


. They are similar to Boolean production 
they are different in two major aspects, 
rule are fuzzy statements, not Boolean 
have linguistic variables describing the 
contribute to the final conclusion. In a 
solely executed. Example 1 shows fuzzy 


Rule_l: if 

then 

Rule_ 2: if 

then 


Temperature is Hot 
Pressure is High 

set Change to Large 

Temperature is Cold 
Pressure is Medium 

set Change to Small 


Example 1: Fuzzy rules for a fuzzy system 


The terms "Hot", "Cold”, "High", "Medium", "Large" and "Small" are linguistic 

^^^“ g! S^r riabIe f ? eSC , rib -f r ie quality 0f a ^“P 1 ° r an 0b j ect in *nn of 

Th • d gre ? of truth 1S defined b y a membership function that maps the 
domain of a concept into a degree of truth between 0 and 1. Figure 1 shows exaSes of 
membership functions of Temperature linguistic variables. g examples of 
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Figure 1: Membership functions for Temperature, Pressure and Change 

Given a temperature value of 70, and a pressure value of 20, the statement Temperature is 
Hot" in Rule 1 is evaluated to a truth value of .6. Similarly, "Temperature is Cold is 
evaluated to .3, "Pressure is High" to .5, and "Pressure is Medium" to .8. 

The typical method of evaluating a rule is by taking the minimum of the truth values of the 
LHS of the rule and applying an alpha-cut [5] to its RHS. The evaluations of Rule 1 and 
Rule 2 are shown in Figure 2. The results from both rules are combined using the 
maximum envelop operation and then defuzzified to give the final answer. There are 
several methods for defuzzification such as the centroid or the mean-of-max methods |5J. 
Figure 2 shows the defuzzification of the variable Change using the centroid method. 



Change 


Figure 2: MIN-MAX operation and defuzzification using centroid method 

As new values of Temperature and Pressure become available, the evaluation cycle repeats 
and a new value for Change is generated. 

Fuzzy system technology has been applied successfully to many difficult control problems. 
It offers a straightforward way to encode human experience of solving real control 
problems into machme automation. The features of linguistic variables and rule 
contribution from fuzzy systems have proven to be very effective in modeling and solving 
many problems for which the continuity of variables involved is critical. 
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There have been several commercial tools developed to facilitate the implementation of 
fuzzy systems. However, they often allow only rules of common consequent and 
therefore, small in number. This small and monolithic characteristic of current ?uzzy 
system implementations prevents them from addressing problems that require deep 
reasoning such as those in the areas of diagnosis, planning, or design. 

Combining the best features of fuzzy systems and Boolean production systems will create 
a general system that can address more effectively a greater range of problem domains. 
Such systems are called fuzzy expert systems. In the following sections we will describe 
our fuzzy system extensions to CLIPS, including design and implementation issues. 


IV. Implementation of Fuzzy Expert Systems in CLIPS 

Our goal is to simply extend CLIPS to allow linguistic variables to be used in rules and to 
provide the necessary fuzzy operations to support them. The addition of support for 
linguistic variables in CLIPS is straightforward and does not pose any conflict with the 
original philosophy of production systems. However, the conflicting approaches of rule 
competition in Boolean production systems and rule cooperation in fuzzy systems needs to 
be resolved in a way that does not violate the original philosophies of either technique. Our 
approach to the CLIPS extensions is to preserve the integrity of CLIPS as much as possible 
and to only introduce new constructs when necessary. 


Linguistic Variable and Operations 

A linguistic variable is defined by a membership function. We implement a membership 
function as a CLIPS class called MFunc. A membership function can then be defined as an 
object instance of the class MFunc. Its value is specified as a piece-wise linear function 
which is a sequence of (x,y) coordinate pairs in the form (xl yl x2 y2 .... xn yn). For 
example, the Hot function is specified as follows: 

(make-instance Hot of MFunc (Func 0 0 10 1 50 0)) 

Once the linguistic variable is defined, a value, for example, 8, can be tested against the 
membership function to give the corresponding degree of truth, or truth value, using the 
function "deg". 


(deg 8 Hot) 

The above statement will return a truth value of .8. Another very useful function is the 
Boolean function "is" which checks out if a value is within the domain of a membership 
function. It returns true if the value is within the domain and false otherwise. For 
examples, 

(is 8 Hot) returns true, and (is -100 Hot) returns false. 

In addition to the class MFunc, a fuzzy variable is represented by the class FVar. For 
example, "Change", an object instance of the class FVar, is first defined as follows: 

(make-instance Change of FVar) 
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A fuzzy variable can have a value of nil or of a piece-wise linear function. This value can 
be combined in the MIN-MAX fashion with another linear piece-wise function to yield a 
new value. 

Using the function "is" in the LHS, the fuzzy rule Rule_l in section III can be rewritten in 
the CLIPS defrule construct as follows: 

(defrule Rule_l 

(Temperature ?x&:(is ?x Hot)) 

(Pressure ?y&:(is ?y High)) 

=> 

(bind ?m (fmin ?x Hot ?y High)) 

(set Change Large ?m)) 

Since the LHS only contains Boolean predicates, it fits into the CLIPS defrule construct. 
Truth values of Temperature and Pressure are not evaluated until the rule is executed. This 
is designed to avoid unnecessary evaluations during the rule matching stage. If the rule is 
chosen for execution, the MIN-MAX operation is performed as specified in the RHS. 

The function "fmin" returns the minimum value of the truth values in the LHS. The 
function "set" then uses this value to perform an alpha-cut on the membership function 
Large, which is then combined with the current value of the fuzzy variable Change using 
the maximum envelop operation. 

With a few new classes and functions, a fuzzy rule can now be written in CLIPS format. 
The next section discusses issues related to the interaction of multiple f uzz y rules. 


Fuzzy Processing 

When multiple fuzzy rules exist in the production memory, a fuzzy cycle has to be 
implemented so that the contributing results to fuzzy variables from each rule can be 
integrated into a single value. We achieve this goal in FCLIPS by having a fuzzy inference 
rule of lower priority or salience value which is executed at the end of each fuzzy cycle. 
The set of fuzzy rules in section III can be rewritten as follows: 

(defmodule Fuzzy_Module 

(defrule Rule_l 

(Temperature ?x&:(is ?x Hot)) 

(Pressure ?y&:(is ?y High)) 

=> 

(bind ?m (fmin ?x Hot ?y High)) 

(set Change Large ?m)) 

(defrule Rule_2 

(Temperature ?x&:(is ?x Cold)) 

(Pressure ?y&:(is ?y Medium)) 

=> 

(bind ?m (fmin ?x Cold ?y Medium)) 

(set Change Small ?m)) 

(defrule Fuzzy_Engine 

(declare (salience -10)) 
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?fl <- (Temperature ?x) 

?f2 <- (Pressure ?y) 

=> 

(retract ?fl ?f2) 

(<check stopping condition> ?x ?y) 

(<defuzzify, apply and reset> Change) 

(<get new values for Temperature & Pressure>)) 

Example 2: A CLIPS-based fuzzy module 

During a fuzzy cycle, the fuzzy variable Change accumulates the results from rules 
executed. At the end of the cycle, the Fuzzy_Engine rule is executed. Change is typically 
defuzzified and the result is asserted into the working memory or sent to an external 
environment. 

To avoid potential interference from other rules in the production memory, this set of rules 
can be conveniently grouped into a CLIPS module. With a few extra fuzzy related classes 
and functions, CLIPS is now capable of supporting traditional fuzzy systems as described 
in section III. There are no changes necessary to the conflict resolution or rule matching 
modules of CLIPS. Yet, a new kind of mixed systems is also now possible. In these 
systems, not only can the LHS of a rule have any number of mixed Boolean or f uzz y 
predicates, but the RHS can also. This is a major improvement from traditional fuzzy 
systems whose rules' RHS have to be about the same subject. 

Of course, due to the differences in the nature of production systems and fuzzy systems, 
there are several issues that need to be addressed for systems that allow mixed rules: (1) 
how to prioritize mixed rules in conflict resolution, (2) how to group fuzzy rules of 
different RHS' into fuzzy modules, (3) how to differentiate fuzzy cycles and Boolean 
cycles, and (4) how to propagate fuzzy conclusions. To illustrate these issues more 
clearly, we will use the examples of the following rules. The assumed truth values of 
antecedents are given on the right. 


rule 1: 


rule 2: 


rule 3: 


if 

then 

if 

then 

if 

then 


(A > 10) 

truth values 
1 

(B is Small) 

.3 

(set C to Large) 
(set D to Medium) 

(A is Large) 

.7 

(D is Small) 

.3 

(set C to Medium) 
(set E to Small) 

(A > 25) 

1 

(X > 25) 

1 

(set E to Large) 

: Mixed rules with different truth values 
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For the first issue, based on the truth values alone, how should these rules be prioritized? 
We argue that they all should have the same priority despite the fact that the truth values for 
some fuzzy predicates are less than others. The fuzzy statement "B is Small" with truth 
value of .3 is no less significant than "A is Large" with truth value .7, because truth values 
in fuzzy logic are not the same as uncertainty values which have been used as a criteria for 
conflict resolution in some systems. "B is Small" with truth value .3 is a description with 
complete certainty of how small B is, which is indicated by the truth value of .3. Besides, 
in traditional fuzzy systems, a small truth value of a fuzzy predicate in a rule does not affect 
the rule's conclusion validity, but only the actual value of the conclusion. Consequently as 
long as a fuzzy predicate has a truth value of greater than 0 in FCLIPS, it is considered 
equivalent to a Boolean statement of value true. This interpretation is particularly 
significant in that it does not require extra processing for mixed rules during the rule 
matching stage. 

The second issue points to the fact that traditional fuzzy systems only allow rules that 
address the same subject on their RHS. In the example above, there is no obvious way to 
group these three rules into fuzzy modules since their RHS' are not exactly about the same 
subjects. Rule l's RHS is about C and D, rule 2 C and E, and rule 3 E. It turns out that 
we don't have to group them, as the following discussion will show. 

The third issue concerns the interpretation of the significance of a fuzzy rule, a Boolean rule 
and a mixed rule. This interpretation is important for determining how conflict resolution 
should be changed. There are two interpretations for the significance of fuzzy rules and 
fuzzy modules versus a Boolean rule. In the first interpretation, a fuzzy module is 
considered equivalent to a Boolean rule in a Boolean production system, since all the rules 
in a fuzzy module can be thought of as being executed in parallel and contributing to a 
single conclusion. This interpretation is valid and in common use [7]. It can already be 
implemented in FCLIPS by using the existing defmodule construct to group fuzzy rules of 
the same module, as shown in Example 2. 

In the second interpretation, all three kinds of rules are equivalent and compete for 
execution on the same grounds. This interpretation is intuitive and less restrictive, but it 
poses a question about when a fuzzy cycle starts and stops, i. e. when is a fuzzy variable 
defuzzified? In FCLIPS, this question of fuzzy cycle is resolved by introducing rules of 
higher salience value specifying defuzzifying conditions for each fuzzy variable mentioned 
in the rules' RHS. An example of a defuzzifying rule for the fuzzy variable C in Example 3 
is as follows: 

Rule DefuzzifyingC: 

if (declare (salience 10)) 

(TimeStamp > 10 ) 

(C not equal nil) 

then 

(<defuzzifying, apply and reset> C) 

There are similar defuzzification rules for D and E. The second issue concerning how to 
group rules into fuzzy modules is no longer an issue, because there is no fuzzy module, 
only defuzzifying conditions for fuzzy variables in a rule consequent. Both interpretations 
are implementable under FCLIPS. The first is more traditional and of common use. The 
second is more general and interesting. 

And finally, the fourth issue concerns the multiple-step reasoning where conclusions 
reached remain in fuzzy form to match the rules in the following cycles. By avoiding 
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defuzzification in intermediate reasoning steps, less information will be lost. Given the 
following two rules. 


Rule 1: 

if 

(A is Small) 


then 

(B is Large) 

Rule 2: 

if 

(B is Small) 


then 

(C is Medium) 


assume that Rule 1 is executed and generates a fuzzy value X for "B is large". The truth 
value for "B is Small" in rule 2 will then be calculated as [15]: 


truth value 


1 - MeanSquareError (X, Small) 


This operation is not yet (but will be soon) implemented in FCLIPS. Currendy, B has to 
be defuzzified after rule 1 execution before being matched into rule 2 antecedent. 


In summary, FCLIPS is an extension to CLIPS to provide a fuzzy expert system 
development environment. Despite its simplicity, it is capable of supporting a i wide rang 
of fuzzy expert systems. An FCLIPS implementation has been fully prototyped and 
successfully tested in CLIPS code. It is currently being ported to C. In addition, a 
ToolTalk interprocess communication facility was added to FCLIPS to commumca e wi 
external processes. In the next section, an example using FCLIPS is described. 


V. Example: The Cart-Pole Balancing Problem 

The Cart-Pole Balancing problem, also called the Inverted-Pendulum problem, is a popular 
test case for fuzzy systems. In this section, we describe the structure and key components 
of a FCLIPS program that solves this problem. The problem is stated as follows. 

A cart is moveable along 1 dimension with a pole on top as shown in Figure 3. Its state 
variables, which include the pole angle, the pole angular velocity, the current positioned 
velocity of the cart, are known. Calculate the appropriate force to apply to the cart to keep 
the pole balanced. 


Angle 




Angular Velocity 


Force 





1 


Velocity 


Position 


Figure 3: Cart-Pole Balancing problem 
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defined ft tak^rt^^r ^ tbat s ^ mu ^ ate s the dynamics of the cart-pole system is 
a new set of Lte variabS ^ ** CUrrent $tate variabIes as arguments and generates 

(deffunction model (?force ?po!ePosition ?poleVelocity 

?cartPosition ?cartVelocity) ...) 

(make-instance A NegMed of MFunc (Func -50 0 -20 1 -15 1 -10 0)) 
(make-instance A_NegSmall of MFunc (Func -20 0 -10 1 0 O')) 

... (more make-instance's) )} 

sys,em is defined in ,he s,ar,up rule - "to. 

(deffule startup 
=> 

(assert (PolePosition 5)) 

(assert (Pole Velocity 0)) 

(assert (Position 0)) 

(assert (Velocity 0))) 

There are 9 rules devised to balance the pole position: 

(defrule Rulel 

(PolePosition ?x&:(is ?x A PosMed)) 

(PoleVelocity ?y&:(is ?y Av_Zero)) 

(bind ?m (fmin ?x A_PosMed ?y Av Zero)) 

(set Force F_PosMed ?m)) ~ 

(defrule Rule2 

(PolePosition ?x&:(is ?x A_PosSmall)) 

(PoleVelocity ?y&:(is ?y Av_PosSmaIl)) 

(bind ?m (fmin ?x A_PosSmall ?y Av PosSmall)) 

(set Force F_PosSmall ?m)) ” ” 

... ( more defrules' ) 

And one deffuzzification rule: 

(defrule engine 

(declare (salience -10)) 

?fl <- (PolePosition ?x) 

?f2 <- (PoleVelocity ?y) 

?f3 <- (Position ?z) 
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?f4 <- (Velocity ?w) 


(retract ?fl ?£2 ?£3 ?f4) 

(bind ?torq (cent-ioid (send [Force] get-Val))) 
(bind ?vals (model ?torq ?x ?y ?x ?w)) 
(assert (PolePosition (nth$ 1 ?vals))) 

(assert (PoleVelocity (nth$ 2 ?vals))) 

(assert (Position (nth$ 3 ?vals))) 

(assert (Velocity (nth$ 4 ?vals)))) 


; delete old facts 
; defuzzification 
; new values 
; create new facts 


The function "centroid" performs defuzzification using the centroid method [5]. The new 
values can be sent to graphs, files or simulation. In our testing, the results were sent via 
ToolTalk to a separate graphic simulation process for displaying the cart-pole system 
behavior. After some tuning of the membership functions, the system was able to balance 
the pole. 


Conclusions 

FCLIPS is a simple and straight-forward implementation of a fuzzy expert system 
development environment based on CLIPS. The CLIPS object-oriented and modularity 
features were exploited to implement fuzzy logic concepts into CLIPS. Despite the 
simplicity of FCLIPS, it can be used to develop systems containing a wide range of mixed 
Boolean and fuzzy rules. With FCLIPS, fuzzy expert system solutions can be introduced 
to problems which typically require deep reasoning such as those in the areas of diagnosis, 
planning, or design. 
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